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Free Probability, Free Entropy and 
Applications to von Neumann Algebras 



Liming Ge* 



This talk is organized as follows: First we explain some basic concepts in non- 
commutative probability theory in the frame of operator algebras. In Section 2, we 
discuss related topics in von Neumann algebras. Sections 3 and 4 contain some of 
the key ideas and results in free probability theory. Last section states some of the 
important applications of free probability theory. 

1. Non-commutative probability spaces 

In general, a non-commutative probability space is a pair {A,t), where A is 
a unital algebra (over the field of complex numbers C) and r a linear functional 
with r(/) = 1, where I is the identity of A. Elements of A are called random 
variables. Since positivity is a key concept in (classical) probability theory, this 
can be captured by assuming that ^ is a * algebra and r is positive (i.e., a state). 
Elements of the form A* A are called positive (random variables). 

A state r is a trace if t{AB) — t{BA). We often require that t be a faithful 
trace (r corresponds to the classical probability measure, or the integral given by 
the measure) . In this talk, we always assume that ^ is a unital * algebra over C and 
T a faithful state on A. Subalgebras of A are always assumed unital * subalgebras. 

Examples of noncommutative probability spaces often come from operator 
algebras on a Hilbert space and the states used here are usually vector states. 

A C*-probability space is a pair {A,t), where ^ is a unital C*-algebra (norm 
closed subalgebra of B{H)) and r is a state on A. 

A W* -probability space is a pair {AA , r) consisting of a von Neumann algebra 
M (strong-operator closed C*-subalgebra of B{TL)) and a normal (i.e., countably 
additive) state r on A^. 

The following are some more basic concepts: 
Independence: In a noncommutative probability space (^1, t), a family {Aj} of 
subalgebras Aj of A is independent if the subalgebras commute with each other and. 
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for n e N, t{Ai ■ ■ ■ An) = t{Ai) ■ ■ ■ r(^„) for all Ak in Aj^ and jk ^ ji whenever 
k^l. 

This independence gives a "tensor-product" relation among subalgebras Aj : if 
A is generated by Aj, then A = (^jAj (in the case of C*- or W*-probability spaces, 
the tensor-product shall reflect the corresponding topological structures on A and 

A,). 

Distributions and moments: Given {A,t), for A in A, we define a map ha '■ 
C[x] ^ C by ha{p{x)) = t{p{A)). Then fiA is the distribution of A. For Ai,. . . ,An 
in A, the joint distribution /xai,...,a„ : C(a;i, . . . ,a;„) — > C is given by 

IJ'Ai,...,A^ {P{X1, Xn)) = t{p{Ai, An)). 

If j3 is a monomial, t{p{Ai , . . . , A^)) is called a (p-)moment. When random variables 
are non self-adjoint, one also considers (joint) * distributions of random variables, 
that can be defined in a similar way. In this case, there is a natural identification 
of C{xi, . . . , Xn, xl,. . . , Xn) with the semigroup algebra CS2n, where S2n is the free 
semigroup on 2n generators. Monomials are given by words in S2n- 
Conditional Expectations: Suppose B is a subalgebra of A. A conditional expectation 
from A onto S is a ,B-bimodule map (a projection of norm one in the case of G*- 
algebras) of A onto B so that the restriction on B is the identity map. 

Many other concepts in probability theory and measure theory can be general- 
ized to operator algebras, especially von Neumann algebras which can be regarded 
as non-commutative measure spaces. For basic operator algebra theory, we refer to 
[KR] and [T]. 

2. GNS representation and von Neumann algebras 

Given a C*-probability space {A,t), one defines an inner product {A,B) = 
t{B*A) on A. Let L?{A,t) be the Hilbert space obtained by the completion of 
A under the L^-norm given by this inner product. Then A acts on L'^{A,t) by 
left multiplication. This representation of A on the Hilbert space L'^{A.t) is called 
the GNS representation. In a similar way, one can define U'{A,t), where \\A\\p = 
T-(mp)i/p = r((AM)P/2)Vp. The von Neumann algebra generated by A (or the 
strong-operator closure of A) is sometimes denoted by L°°{A,t) (c Lp{A,t), p > 
1). All von Neumann algebras admit such a form. Any von Neumann algebra is a 
(possibly, continuous) direct sum of "simple" algebras, or factors (algebras with a 
trivial center). Von Neumann algebras that admit a faithful (finite) trace are said 
to be finite. The classification of (infinite-dimensional) finite factors has become 
the central problem in von Neumann algebras. 

Murray and von Neumann [MN] also separate factors into three types: 

Type I: Factors contain a minimal projection. They are isomorphic to full 
matrix algebras M„(C) or B{Ti). 

Type II: Factors contain a "finite" projection but without minimal projections: 
it is said to be of type IIi when the identity 7 is a finite projection; of type IIoo 
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when I is infinite. Every type IIoo is the tensor product of BiH) with a factor of 
type III. 

Type III: Every (non zero) projection is infinite. 
ExEimples of von Neumann algebras: 1) Let A = CG for some discrete group 
G, H be 1^{G) and r be the vector state given by the vector that takes value 1 at 
g and elsewhere. Then r is a trace, P(G) = L'^(A,t) and the weak (or strong) 
operator closure of A is called the group von Neumann algebra, denoted by Cq- 
We have that jCg is a factor if and only if each conjugacy class of G other than the 
identity is infinite (i.c.c). For example, the free group F„ (n > 2, on n generators) 
is such an i.c.c. group. 

2) Suppose {ft, ji) is a measure space with a u-finite measure /x, G is a group 
and a is a measur ability preserving action of G on O. Formally, we have an alge- 
bra i°°(ri, /i)G (= A) similar to the group algebra definition: {(p{x)g){ijj{x)h) = 
(p{x)tp{g~^ {x))gh, for ip,'ip & L°°{il,iJ,) and g,h £ G. Assume that G acts freely 
(i.e., for any g in G with g ^ e, the set {x e O : g{x) = x} has measure zero). 
Define an action of A on the Hilbcrt space ®g^Q L'^(fl,iJ,)g by left multiplication 
( which is induced by the multiplication in A), where L^{n,j2)g is an isomorphic 
copy of i^(fi, /i). Then the von Neumann algebra generated by A is called the cross 
product von Neumann algebra, denoted by L°°{Q.,ix) XaG. This cross product is 
a factor if and only if a is ergodic. If a is crgodic and not a measure preserving 
action, then L°°(f2, /x) G is a factor of type III. Type II factors are obtained from 
measure preserving actions (with O a non atomic measure space) and the finiteness 
of n gives rise to type IIi factors. 

The above 1) and 2) are the two basic constructions of von Neumann alge- 
bras (given by Murray and von Neumann [MN]). A. Connes [C] shows that there 
are finite factors that cannot be constructed by 1). It was a longstanding open 
problem whether every (finite) von Neumann algebra can be obtained by using the 
construction in 2). Using free probability theory, especially the notion of free en- 
tropy, Voiculescu [V2] gives a negative answer to this question. We shall discuss 
some details later in the talk. 

In recent years, the focus of studies of von Neumann algebras is centered on 
factors of type IIi. Many of the unsolved problems in operator algebras are also 
reduced to this class. We end this section with two of the (still) open problems from 
the list of 20 questions asked by Kadison in 1967. 

1. The weak-operator closure of the left regular representation of the free (non- 
abelian) group on two or more generators is a factor of type IIi. Are these factors 
isomorphic for different numbers of generators? 

2. Is each factor generated by two self-adjoint operators? — each von Neumann 
algebra? — the factor arising from the free group on three generators? — is each 
von Neumann algebra finitely generated? 

Three of those 20 problems were answered in the last ten years by using free 
probability and free entropy. We explain some of the theory involved in the following 
two sections. 
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3. Free independence 

Suppose {A,t) is a C*-probability space. We assume that r is a trace. A 

family A^, l G 1, oi unital * subalgcbras of A are called free with respect to t if 
t{AiA2 ■ ■ ■ An) = whenever Aj G Aij , ii ^ ■ ■ ■ ^ in {I'l and 13 may be the same) 
and T{Aj) = for 1 < j < n and every n in N. A family of subsets (or elements) 
of A are said to be free if the unital * subalgebras they generate are free. 

Note that freeness is a highly noncommutative notion, the non-commutativity 
(or algebraic freeness) of free random variables is encoded in the definition. Recall 
some basic concepts in free probability theory. 

Semicircular elements: The Gaussian laws in classical theory is replaced by 
the semicircular laws. The semicircular law centered at a and of radius r is the 
distribution ^a,r '■ C[x] — > C such that 

2 ra+r 
T^r^ Ja-r 

for each (p{x) in C[x]. A self-adjoint random variable A in {A,t) is said to be 
(standard) semicircular if its distribution is /io,i- An element X = A + iB is 
circular if A and B are free semicircular. The following theorem is proved by D. 
Voiculescu (sec [VDN]). 

Free Central Limit Theorem: Let {Aj}°^^ he a free family of identically dis- 
tributed random variables in {A, r) with T{Aj) = and t{A^) = ^ for some positive 
number r. Then the distribution of converges to the semicircular law jiQ^r- 

Classical independence corresponds to tensor products; while the above free 
independence introduced by Voiculescu is given by certain free products. Recall 
some examples of such freeness. 

Free products: If G = Gi * G2, then Cq^ and Cg^ are free in Cg, here the trace 

is the one given by the unit vector associated with any group clement. 

Let {Ai,Ti) and (.42, T2) be two W*-probability spaces. Suppose ^0 is the 
(amalgamated algebraic) free product of A\ and A^ (over the scalars). Then there is 
a unique r on Ao such that A\ and A2 are free with respect to r and the restrictions 
of T on Ai and A2 equal to ti and T2, respectively. Let A be the weak operator 
closure of ^0 acting on L?{Aq,t). Then A is called the (reduced von Neumann 
algebra) free product of Ai and A2 (with respect to r), denoted by A\ * A2 (and 
r = Ti * T2). For example, Cf^, = L°°[Q, 1] * L°°[0, 1]. 

Full Fock space construction: Let Ho be a real Hilbert space and H be Ho (8) C. 
Its full Fock space is 

T(H) = C1®0H®". 

n>l 

For h e Ho, let the left creation operator I (h) £ B{T{H)) be given by l{h)^ = h(^^. 
Then l{h)*l = and ^(/i)*^i (g) 6 = (6, O • • • O Cn, so l{hi)*l{h2) = 

(/i2, hi)I. Let C*{l{Ho)) (or W*{l{Ho))) be the G*- (or W*-) algebra generated by 
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{l{h)\h e Ho}- Let co-h be the vector state given by the vector 1 e TiTi). Here 1 is 

called the vacuum vector and LUfi the vacuum state. If Tii and 7^2 are orthogonal 
subspaces of Ho, then C*{l{Hi)) and C*{l{H2)) are free (with respect to co-h)- If h 
is a unit vector in Hq, then {l{h) + l{h)*)/2 is semicircular with distribution /io,i- 

Gaussian Random Matrices: Let X{s,n) = {fij{s,n)) in M„(L°°[0, 1]) be real 
random matrices, where n G N and s € S for some index set S. Assnmc; that 
fij{s,n) = fji{s,n) and {fij{s,n) : i,j,s} (given each n) is a family of indepen- 
dent Gaussian (0, 1/n) random variables. Let D„ be a constant diagonal matrix in 
M„(R) having a limit distribution (as n oo). Then {X{s,n)} U {Dn} is asymp- 
totically free as n — !■ cx3 and {X{s,n) : s G 5} converges in distribution to a free 
semicircular family. As a corollary, Voiculescu shows that d) M2{C) = Lp-^- 
Moreover ® -^n(C) = -Cf^^^-i i fo'^ ^'^^y "^^^ number r, and Lp^ * I^Fs — ^Fr+s- 

Now we know that either Cf^, r > 1, are all isomorphic to each other or they are 
all non isomorphic factors (see [D] and [R]). 

Further studies of free probability theory have been pursued by many people 
in several directions, such as infinitely divisible laws, free brownian motion, etc. (we 
refer to [B], [VDN] and [HP] for details). 

4. Free entropy 

Free entropy is a non commutative analogue of classical Shannon entropy. First 
we recall the definition of entropy and its basic properties. 

Classical Entropy: Let (f2, S, /i) be a probability space with probability measure /i 
and fi, ■ ■ ■ , fn : R be random variables. Suppose ip is the density function on 
R" corresponding to the joint distribution of /i, . . . , /„. Then the entropy: 



Here are two important properties of entropy: H{fi, . . . , fn) = H{fi) + • • • + H{fn) 
if and only if /i, . . . , /„ are independent: when assuming that E{fJ) = 1, H is 
maximal if and only if /i, . . . , /„ are Gaussian independent (0, 1) random variables. 
Free entropy: Let Ai,...,A„ be self-adjoint random variables in {A,t). For any 
£ > 0, when k large, there may be self-adjoint matrices Ai,. . . ,An in Mfc(C) such 
that "the algebra generated by Xj 's looks like the algebra generated by Aj 's within 
£. " More precisely, for any e > 0, large w G N and any monomial p'm.C{xi, . . . ,Xn) 
with degree less than or equal to m, choose k large enough so that 



Let r/{(Xi, . . . , Xn] rn, k, e) be the set of all self-adjoint matrices (Ai. .... A,,) 
in Mfc(C), with \\Aj\\ < R, such that (*) holds. The limit of the "normahzcd" 
measurement of rii{Xi, ... ,Xn;m,k,e) is called the free entropy of Xi,...,A„. 
Voiculescu [VI] shows that this limit is independent of R when it is larger than 




ip{ti ,...,tn) log (fi{ti, tn)dti ■■■dtn- 



(*) 



|r(p(Ai,...,X„)) -rfe(p(Ai,... 



An))\ < e. 
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niax{||Xj|| : j = 1, • • • , n}. Here we will fix such a constant R and use T{Xi, . . . , X„; 
m, k, e) to denote F^f (Xi, . . . , X„; m, k, s). Let vol be the cuclidcan vohimc in real 
euclidean space (-Mfc(C)* '' )" (here "s.a." denote the self-adjoint part and the 
euclidean norm \\A\\l = Tr(^^)). Now we define, successively, 

x{Xi, . . . ,Xn;m,k,e) = log'uo;(r(Xi, .... X„: m, k,e)), 

x(Xi, ...,Xn;m,e)= limsup(A;"^x(-'^i, ■ ■ ■ ,Xn;m,k,e) + ^ log k), 
X{Xu . . . , X„) = inf{x(Xi, . . . , X„; m, £) : m e N, £ > 0}. 

We call xi^ij • ■ • ) ^n) the free entropy of {Xi, . . . , X„). 

The following are some basic properties of free entropy (proved in [VI]): 

(i) x(^i,...,^«)< f log(27reC2n-i); 

(ii) x(-'^i) = Jj log |s — t\diJ,i{s)diJ,i{t) + | + | log 2n, where fii is the (measure 
on the spectrum of Xi corresponding to the) distribution of Xi ; 

(iii) x(^i, • • • ) = x{Xi) H h x{Xn) when Xi , . . . , X„ are free random 

variables. 

Voiculescu also introduces a notion of free entropy dimension 6{Xi, . . . ,X„) 
which is given by 

crv v\ IT Xi^l + ^Sli, ... ,Xn + eSn ■ Si, ... ,Sn) 

S(Xi, . . .,Xn) = n + limsup ^ ; - 

e^O I log £ I 

where {Si, . . . , Sn} is a standard semicircular family and {Xi, . . . , X^} and {Si, . . ., 
Sn} are free. 

5. Applications 

In this section, we review some of the applications of free entropy in von 
Neumann algebras. 

Theorem 1. ([VI]) Let Si,. . . ,Sn be a standard (0,1) free semicircular family. 
Then 

x{Si,...,Sn) = n{\+\og^); 

5{Si,...,Sn) = n. 

Note that 5*1 , . . . , S'„ generate Cp^ as a von Neumann algebra. 
Theorem 2. ([V2]) If a finite von Neumann algebra A4 (with a trace) has a Cartan 
subalgebra, then, for any self-adjoint generators Xi, . . . , X^ of Jv[, 6{Xi, . . . , X„) < 
1. 

This implies that free group factors do not contain any Cartan subalgebras 
which answers a longstanding question in the subject. 

The following result generalizes Voiculescu's result and answers Problem 11 
on Kadison's 1967 problem list (unpublished). 
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Theorem 3. ([Gl]) If a finite von Neumann algebra M. (with a trace) has a simple 
maximal ahelian subalgebra, then, for any self-adjoint generators Xi, . . . ,X„ of A4, 
5(Xi,...,X„)<2. 

Furthermore, we prove the following result which shows the existence of a 
separable prime factor (the one that is not the tensor product of two factors of the 

same type). 

Theorem 4. ([G2]) If M = Mi^M2 for some infinite dimensional finite von 
Neumann algebras M.i and A42, then, for any self-adjoint generators Xi,. . . ,Xn 
ofM, 5{Xl,...,Xn) < 1. 

It is an outstanding open question whether the free entropy dimension is an 
invariant for von Neumann algebras. Following Voiculescu's result in [V3], we prove 
the following: 

Theorem 5. ([GS]) For any self-adjoint generators Xi, . . . , X„ of jCsl^{z)! to > 3, 
5(Xi,...,X„)<l. 

The above theorem is not true for SL2{Z). 
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